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Abstract 

We introduce the first operator splitting method for composite monotone inclusions outside 
of Hilbert spaces. The proposed primal-dual method constructs iteratively the best Bregman ap¬ 
proximation to an arbitrary point from the Kuhn-Tucker set of a composite monotone inclusion. 
Strong convergence is established in reflexive Banach spaces without requiring additional re¬ 
strictions on the monotone operators or knowledge of the norms of the linear operators involved 
in the model. The monotone operators are activated via Bregman distance-based resolvent op¬ 
erators. The method is novel even in Euclidean spaces, where it provides an alternative to the 
usual proximal methods based on the standard distance. 
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1 Introduction 


Let Af be a reflexive real Banach space with norm || • || and let (•,■) be the duality pairing be¬ 
tween X and its topological dual X*. A set-valued operator M: X ^ 2^* with graph graM = 
{(a:,®*) & X X X* \ X* & Mx] is monotone if 

{y{xi,xl) e graM){y{x 2 ,X 2 ) e graM) {xi - X 2 ,xl - X 2 ) ^ 0, (1.1) 

and maximally monotone if, furthermore, there exists no monotone operator from X to 2^* the 
graph of which properly contains graM. Monotone operator theory emerged in the early 1960s 
as a well-structured branch of nonlinear analysis [24, 29, 30, 41], and its remains very active 
[9, 10, 35, 42]. One of the main reasons for the success of the theory is that a significant range 
of problems in areas such as optimization, economics, variational inequalities, partial differential 
equations, mechanics, signal and image processing, optimal transportation, machine learning, and 
traffic theory can be reduced to solving inclusions of the type 

find x^X such that 0 € Mx, (1.2) 

where M: X ^ 2^* is maximally monotone. Conceptually, this inclusion can be solved via the 
Bregman proximal point algorithm, special instances of which go back to [22, 25, 36] . To present its 
general form [7], we need the following definitions, which revolve around the notion of a Bregman 
distance pioneered in [13]. 

Definition 1.1 [6, 7] Let A’ be a reflexive real Banach space and let /: A” — > ]— oo,+oo] be 
a proper lower semicontinuous convex function, with conjugate f*:X* —> ]—oo,+oo] : x* 1-^ 
2 :*) — f{x)) and Moreau subdifferential [32] 

df: X ^ 2^*: x {x* e X* \ (Vy e X) {y - x,x*) + f{x) ^ /(y)}. (1.3) 

Then / is a Legendre function if it is essentially smooth in the sense that df is both locally bounded 
and single-valued on its domain, and essentially strictly convex in the sense that df* is locally 
bounded on its domain and / is strictly convex on every convex subset of dom5/. Moreover, / 
is Gateaux differentiable on int dom/ 7^ 0 and the associated Bregman distance is 

D-f : X X X ^ [0, + 00 ] 

( fhj)-{x-y,^f{y)), if ye int dom/; (1.4) 

otherwise. 

Let C be a closed convex subset of X such that C n int dom/ / 0. The Bregman projector onto C 
induced by / is 

p [,: int dom/ ^ C n int dom/ 

y ^ argrainD^{x,y). (1-5) 

xec 
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The fact that, for every y € int dom/, P[,y e int dom/ exists and is unique is established in [ 6 , 
Corollary 7.9]. It follows from [7, Theorem 5.18] that, under suitable assumptions on / and M, 
given a sequence ( 7 n)neN in ] 0 , +oo[ such that inf^g^y^ > 0 , the sequence defined by 

xo € int dom/ and (Vn G N) x^+i = (V/ + 7 nM)“^ o S7f{xn) (1.6) 

converges weakly to a solution to (1.2) (in the case when T” is a Hilbert space and / = || • |P/2, 
(V/+ 7 nM)“^ o V/ reduces to the standard resolvent and we obtain the classical result of [34, 
Theorem 1]). A strongly convergent variant of (1.6) was proposed in [8]. In applications, however, 
M is typically too complex for (1.6) to be implementable. For instance, given a real Banach space y, 
a typical composite model is M = A + L*BL, where A: X ^ 2“^* and B: y ^ 2^* are monotone, 
and L: X ^ y is linear and bounded. In Hilbert spaces, if X = y and L = Id, several well- 
established splitting methods are available to solve (1.2), i.e., to find a zero of A + B using A and 
B separately at each iteration [9, 27, 28, 37]. Splitting methods for the more versatile composite 
model M = A + L*BL in Hilbert spaces were first proposed in [14] (see [1, 11, 12, 19, 20, 38] 
for subsequent developments). These methods provide in general only weak convergence to an 
unspecified solution and, in addition, they require knowledge of ||L|| or potentially costly inversions 
of linear operators. The recent method primal-dual method of [3] circumvents these limitations 
and, in addition, converges to the best approximation to a reference point from the Kuhn-Tucker set 
relative to the underlying hilbertian distance. The objective of this paper is to extend it to reflexive 
Banach spaces and to best approximation relative to general Bregman distances. Let us stress that 
the theory of splitting algorithms in Banach spaces is rather scarce as most hilbertian splitting 
methods cannot be naturally extended to that setting; in particular, to the best of our knowledge 
there exists at present no splitting algorithm for finding a zero of M = A + L*BL outside of Hilbert 
spaces. By contrast, the geometric primal-dual construction of [3], which consists in projecting a 
reference point onto successive simple outer approximations to the Kuhn-Tucker set of the inclusion 
0 € Ax + L*BLx, lends itself to such an extension. Our analysis will borrow tools on Legendre 
functions and Bregman-based algorithms from [6] and [7], as well as geometric constructs from 
[3] and [8] . The proposed results will provide not only the first splitting methods for composite 
inclusions outside of Hilbert spaces, but also new algorithms in Hilbert, and even Euclidean, spaces. 

The problem under consideration is the following. 

Problem 1.2 Let X and y be reflexive real Banach spaces such that X ^ {0} and y 7 ^ {0}, let X be 
the standard product vector space X x y* equipped with the norm {x,y*) i-)- -^||x|p + ||r/*P, and 
let X* be its topological dual, that is, X* xy equipped with the norm {x*,y) 1 -^ ^||x*|p + ||yP. Let 
A: X ^ 2^* and B: y ^ 2^* be maximally monotone, and let L: X —> T’ be linear and bounded. 
Consider the inclusion problem 

find x ^ X such that 0 G Ax + L*BLx, (1.7) 

the dual problem 

find y* G 3^* such that 0 G -LA-^{-L*y*) + (1.8) 

and let 

Z = {{x,y*) e X \ -L*y* e Ax and Lx e B-^y*} (1.9) 
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be the associated Kuhn-Tucker set. Let f: X ^ ]— (X),+oo] and g: y ^ ]— oo,+oo] be Legendre 
functions, set 

f : X ^ ]-oo,+oo] : (x,y*) f{x) + (1.10) 

let xo € intdom/, let e intdomg'*, and suppose that Z n intdom/ / 0 . The problem is to find 
the best Bregman approximation (x,y*) = F^(xo,yQ) to (xo,yo) from Z. 

Notation. The symbols ^ and denote respectively weak and strong convergence. The 
set of weak sequential cluster points of a sequence (xn)nGN is denoted by The closed 

ball of center x G X and radius p G ]0, +oo[ is denoted by B{x;p). Let M: X —)• 2^* be a set¬ 
valued operator. The domain of M is domM = {x G X | Mx ^ 0], the range of M is ranM = 
{x* G X* I (3 x G X) X* G Mx], and the set of zeros of M is zerM = {x G X \ 0 G Mx]. ro(d:’) 
is the class of all lower semicontinuous convex functions f: X ^ ]—cx),+cx3] such that dom/ = 
{x G d:” I /(x) < +oo} 7 ^ 0. Let f : X —>■ ]— cx3, +cx)]. Then / is coercive if lim|| 3 .||_^_|_oo /(x) = +cx) 
and supercoercive if lim|| 3 ,||^_,_oo /(x)/||x|| = +oo. 


2 Preliminary results 

2.1 Properties of the Kuhn-Tucker set 

The following proposition revisits and complements some results of [2] and [14] on the properties 
of the Kuhn-Tucker set in the more general setting of Problem 1.2. 

Proposition 2.1 Consider the setting of Problem 1.2. Then the following hold: 

(i) Let ^ be the set of solutions to (1.7) and let be the set of solutions to (1.8). Then the following 
hold: 

(a) Z is a closed convex subset of LP x 

(b) Set Qx: X ^ X: {x,y*) X and Qy* ■. X ^ y* -. {x, y*) i-7> y*. Then SP = Qx{Z) and 

Qy*{Z). 

(c) .^/0<^Z/0<t»^/0. 

(ii) For every a = (a, a*) G graA and b = (6,6*) G graB, set s* t, = (“* + L*b*,b — La), 7?a,b = 
{a, a*) + (6,6*), and = [x G X \ {x, s* [^) ^ r/a,b}. Then the following hold: 

(a) (Va G gra^)(Vb G graS) [s*^ = 0 H^y = X => {a,b*) G Z and = Q]. 

i-h) Z PlaGgraA flbegraf? ^3,h ■ 

(hi) Let {un, a*)neN be a sequence in graA, let {bn, 6* )ngN be a sequence in gra B, and let (x, y*) G X. 
Suppose that an x, ^ y*, + L*h^ —> 0, and Lon — 6„ —> 0. Then {x,y*) G Z. 
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Proof. Set M : X ^ 2 ^*: {x,y*) ^ Ax y. B~^y* and S: X ^ X* : {x,y*) {L*y*, —Lx). Since A 

and are maximally monotone, so is M. On the other hand, S is linear, bounded, and positive 
since 

(V(x, y*) € AT) {S{x, y*), {x, y*)) = {x, L*y*) + {-Lx, y*) = 0. (2.1) 

Thus, it follows from [35, Section 17] that S is maximally monotone with dom S = X. In turn, we 
derive from [35, Theorem 24.1(a)] that 

M + S is maximally monotone. (2.2) 

(i)(a): Let {x,y*) E X. Then 

0 & M{x,y*) + S{x,y*) ^ 0 G Ax + L*y* and 0 G B~^y* — Lx 

^ -L*y* G Ax and Lx G B-^y* 

^ (x,y*)GZ. (2.3) 

Therefore, we derive from (2.2) and [15, Lemma 1.1(a)] that Z = zer (iW + 5) = (iW + S')“^(0) is 
closed and convex. 

(i)(b); Let x G X. Then xG^<=^^G Ax + L*BLx {3 y* G T^*) [-L*y* G Ax and y* G 
BLx] (3y* G 3^*) {x,y*) G Z. Hence ^ 0 4^ Z 0. Likewise, let y* G y*. Then 

y* G ^ 0 G -LA~^{-L*y*) + B~^y* (3x E A”) [x E A~^{-L*y*) and 0 E -Lx + B~^y*\ 

(3x E A’) [-L*y* G Ax and Lx G B-^y*] ^ (3 xGX) (x,y*) G Z. 

(i) (c): Clear from (i)(b) (see also [33, Corollary 2.4]). 

(ii) (a) : Let a E gra A and b E graB. Then s* [^ = 0 ^ [—L*b* = a* G Aa and La = b G B~^b*] 
^ {a,b*) G Z. In addition, 

^a,b = 0 ^ = {a,a*) + {b,b*) = {a,-L*b*) + {La,b*) 

= -{La,b*) + {La,b*) = 0. (2.4) 

Thus Sg b ~ ^ ^ = A'. Conversely, iTa,b = %,b = 0. 

(ii)(b): First, suppose that x = {x,y*) G flaegranflbegras-f^a,b- Then 

(Va E graA)(Vb E grail) {{a,b*) - {x,y*), {a*,b) - {-L*y*,Lx)) 

= {{a -x,b* - y*), (a* + L*y*,b - Lx)} 

= (a - X, a* + L*y*) + {b - Lx, b* - y*) 

— 4a,b “ {x, Sg b) 

^ 0. (2.5) 

On the other hand, since 

{{{a,b*),{a*,b)) \ a E graA,b E grafi} = graM, (2.6) 
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it follows from (2.2) and (2.5) that ((x,y*), {—L*y*,Lx)) G graiW, i.e., x £ Z. Thus 

f| f| T/a.bCZ. (2.7) 

aggraA b€graS 

Conversely, let a G gra^, let b G grai?, and let (x, y*) G Z. Then (x, —L*y*) G gra A and (Lx, y*) G 
graL. Since A and B are monotone, we obtain 

{a — x,a* + L*y*) ^ 0 and {b — Lx,b* — y*) ^ 0. (2.8) 

Adding these two inequalities yields 

(x -a,a* + L*y*) + (Lx -b,b* - y*) < 0 (2.9) 

and, therefore, 

<,b) = 0* + L*b*) + (6 - La, y*) 

= (x, a* + L*y*) + (Lx, 6* - y*) + (6 - Lx, y*) + (x - a, L*y*) 

= (x - a, a* + L*y*) + (a, a*) + (La, y*) 

+ (Lx -b,b* - y*) + (6,6*) - (6, y*) + (6 - Lx, y*) + (x - a, L*y*) 

^ (a, a*) + (5, 6*) + (La - b, y*) + (6 - Lx, y*) + (x - a, L*y*) 

= (a,a*) + (6,6*) 

= r?a,b. (2.10) 

This implies that (x,y*) G iTa,b- Hence, Z c iTa,b- 

(hi): Set (Vn G N) = (a„,6*) andx* = (a*+L*6*, Lan). Thena;„ ^ {x,y*), > 0, and 

(Vn G N) (x„,a;*) G gra(M' + 5). However, it follows from (2.2) that gra{M + S) is sequentially 
closed in x ;v’*strong Lemma 1.2]. Hence, 0 G {M + S){x,y*), i.e., by (2.3), (x,y*) G Z. 

□ 

Proposition 2.2 Consider the setting of Problem 1.2. Then the following hold: 

(i) f is a Legendre function. 

(ii) The solution (x, y*) to Problem 1.2 exists and is unique. 

Proof, (i): Since / and g are Legendre functions, so are /* and g* [6, Corollary 5.5]. Therefore, 
it follows from [6, Theorem 5.6(iii)] that df and dg* are single-valued on dome)/ = intdom/ 
and domOy* = intdomy*, respectively. On the other hand, we derive from (1.10) that domf = 
dom / X dom g* and that 

(x,y*) df{x) X dg*{y*). (2.11) 

Thus, df is single-valued on 

dom df = dom df x dom dg* = int dom / x int dom g* = int (dom / x dom g *) = int dom f. (2.12) 
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Likewise, since 


f*: X* ^ ]-cx), +CX)] : {x*,y) H- f*{x*) + g{y), (2.13) 

we deduce that df* is single-valued on dome)/* = intdom/*. Consequently, [6, Theorems 5.4 
and 5.6] assert that / is a Legendre function. 

(ii); It follows from Proposition 2.1(i)(a) that Z is a closed convex subset of X. Hence, since 
Z n intdom / / 0, we derive from (i) and [6, Corollary 7.9] that {x,y*) = P^ixo^y^) is uniquely 
defined. □ 


2.2 Best Bregman approximation algorithm 

The approach we present goes back to Haugazeau’s algorithm [23, Theoreme 3-2] (see also [9, 
Theorem 29.3]) for projecting a point onto the intersection of closed convex sets in a Hilbert space 
using the projections onto the individual sets. The method was extended in [18] to minimize certain 
convex functions over the intersection of closed convex sets in Banach spaces. The adaptation to 
the problem of finding the best Bregman approximation from a closed convex set was investigated 
in [8]. 

Definition 2.3 [7, Definition 3.1] and [8, Section 3] Let A' be a reflexive real Banach space, let 
/ G To (A:') be a Legendre function, let xq g intdom/, let x G intdom/, and let y G intdom/. 
Then 


Hf{x,y) = { 2 : G A:' I {z - y,V f{x) - V f{y)) ^ O} 

= { 2 : G A:' I {z, y) + (y, x) ^ D^{z, a;)} (2.14) 

is the closed affine half-space onto which y is the Bregman projection oi x ii x ^ y. Moreover, if 
Hf {xq, x) n Hf {x, y) n intdom / / 0 , then 

Q^{xo,x,y) = PHfi^xo,x)nHf{x,y)^^- (2.15) 

Lemma 2.4 [7, Lemma 3.2] Let X be a reflexive real Banach space, and let Ci and C 2 be convex 
subsets of X such that Ci is closed and Ci n int C 2 / 0. Then Ci n int C 2 = Ci n C 2 . 

Proposition 2.5 Let X be a reflexive real Banach space, let f G ro(X) be a Legendre function, let C 
be a closed convexsubset o/dom / such that Cnintdom / / 0, let xq g intdom f, and setx = p[;Xq. 
At every iteration n G N, find a;„_,_i /2 € intdom / such that C C {xn, ®n-i-i/ 2 ) set 

Xn+l — (®0) ®n-|-l/2) ■ (2.16) 

Then the following hold: 

(i) (Vn G N) C C Hf{xo, Xn). 
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(ii) (a?n)nGN ^ Well-defined bounded sequence in intdom /. 

(iii) Suppose that, for some n eN, Xn E C. Then (VA: G N) 

(iv) x^i) <C “hoc. 

(v) (f/n E N) ^n) ^ (^n+l? ^n)* 

(vi) Enei^Df{x n+l/2)®n) < +00. 

(vii) [ X^i ^ X Q.71(i f {Xji^ y f (x^ ] {p^ni ^ 0 (Z C. 


Proof. Item (i) is found in [ 8 , Proof of Proposition 3.3]. The first equivalence in (vii) follows from 
[ 8 , Propositions 2.2(ii)]. To establish the remaining assertions, set 


(VneN) Tn = PL, ,. 


(2.17) 


Then, for every n G N, Definition 2.3 yields Tn,Xn = ®n+i/2> [7, Proposition 3.32(ii)(b)] yields 
Fixr,^ = IJf {xn, Xn+ 112 ) n int dom/, and we derive from Lemma 2.4 that 


C C iT'^(®„,£c,j+i/ 2 ) ndom/ = iT.f(®„,a;„+i/ 2 ) Hint dom/ = FixT„. 
On the other hand, 

(Vn G N) 0 / C n intdom / c {xn,Xn+i/ 2 ) H intdom / = FixT„ 


(2.18) 


(2.19) 


and, therefore, Pl^gj^FixT^ / 0 . Altogether, [ 8 , Condition 3.2] is satisfied and it follows from [ 8 , 
Propositions 3.3 and 3.4] and [ 8 , Proof of Proposition 3.4(vii)] that the proof is complete. □ 


2.3 Coercivity and boundedness of monotone operators 

Definition 2.6 Let A” be a reflexive real Banach space such that A 7 ^ {0} and let M; A — 2^*. 
Then M is coercive if 

(BzGdomM) lim inf= _|_oo, ( 2 . 20 ) 

|| a :||—>-+00 || x || 

and it is bounded if it maps bounded sets to bounded set. 

Lemma 2.7 Let X be a reflexive real Banach space such that X / {0} and let M\ X ^ 2^*. Suppose 
that one of the following holds: 

(i) dom M is nonempty and bounded. 

(ii) M is uniformly monotone at some point z G domM with a supercoercive modulus: there 
exists a strictly increasing function f: [ 0 , +oo[ — [ 0 ,+00] that vanishes only at 0 such that 

lim 4>{t)/t = +00 and 

t—)-+oo 

(V(x, X*) G graM)(Vz* G Mz) {x — z,x* — z*) ^ (f){\\x — z\\). (2.21) 


8 





(iii) M = dip, where p is a supercoercive function in ro(A:’). 
Then M is coercive. 


Proof, (i): Let x € X and let z E domM. Then, if ||x|| is sufficiently large, we have Mx = 0 and 
therefore inf {x — z, Mx)/||x|| = +oo. 


(ii) ; We have 

(V(x, X*) E graM)(Vz* E Mz) {x — z,x* — z*) > </>(||x — z\ 
Hence, for every x E domM such that ||x|| > || 2 ;||, we have 


(Vx* E Mx){\fz* E Mz) ^ > 


X — z\\] — X — z \\z 


X — z\ 


x|| 

X — z\ 


— \ z 


X — z\ 


Thus, 


. ,{x - z,Mx) 
lim int -r—r- = +00. 

||a:||—>-+oo X 


( 2 . 22 ) 


(2.23) 


(2.24) 


(iii): In view of (i), we suppose that domM is unbounded. Let z E domM. Then we derive 
from (1.3) that, for every x E domM \ {0}, 


||x|| ||x|| 

Hence, the supercoercivity of p yields 

.Ax- z,Mx) 
lim int-r—r-= +00 

||a;||—>-+oo X 


(2.25) 


(2.26) 


and M is therefore coercive. □ 


Lemma 2.8 Let X be a reflexive real Banach space such that X { 0 }, let Mi : X — 2^*, and let 
M2 : X 2^* be monotone. Suppose that there exists z E dom Mi n dom M2 such that 


lim inf 

||a:||^+oo 


(x — z, Mix) 


= +00. 


(2.27) 


Then Mi + M 2 is coercive. 


Proof. Suppose that x E (dom Mi n dom M2) \ { 0 }, let x* E (Mi + M2)x, and let 2;* E (Mi + M2)z. 
Then there exist Xi E Mix, X2 E M2X, z* E M12;, and 23 E M2Z such that x* = Xi + X2 and 
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z* = zf + Z 2 - In turn, the monotonicity of M 2 yields 

(x — Z, X*) {x — Z,x\ — Zi) ^ {x — Z,X 2 — Z 2 ) {x — z, z*) 
||x|| ||x|| ||rc|| ||x|| 

> (x - z,xl) {x - z,zl) 

" Ikll Ikll 

^ (x — Z,X^) — ||x — z\\ IIZ 2 II 

^ n n 

||x|| 

and (2.27) implies that Mi + M 2 is coercive. □ 


(2.28) 


Lemma 2.9 Let X be a reflexive real Banach space such that X {0}, let Mi; X —)• 2^*, let M 2 ; X —)• 
2^* be monotone, let (x* ),igN be a bounded sequence in X*, and let (7n)neN be a bounded sequence in 
]0, +oo[. Suppose that there exists z G domMi n domM 2 such that 


lim inf 

||ic||—>-+00 


(x — z, Mix) 


= +C) 0 , 


and that 


(2.29) 


(Vn G N) Xn G (Ml + 7 nM 2 ) ^x*. 


(2.30) 


Then (xn)nGN is bounded. 


Proof. Set /3 = sup^gj^ ||x* || and a = sup„gis} 7 „. It follows from (2.30) that, for every n G N, there 
exist a* G Mix„ and 6* G M 2 X„ such that + 7nbn- If (Xn) ngN is unbounded, there exists a 

strictly increasing sequence (kn)neN in N such that 0 < ||xfc„|| t +oo- Therefore, (2.29) yields 


{xk,,-z,al) 

hm -r-r —— = + 00 . 

n^+00 llxfc^ll 


(2.31) 


Now let z* G M 2 Z. By monotonicity of M 2 , (Vn G N) (x^^ — z, — z*) ^ 0. Hence, (2.31) implies 
that 

/3(l + 


Ikfcol 


^ /3( 1 + 


Ikfcn -4 




\\XkJ 
{Xk,,-z,xlj 


\\XkJ 

4kr,-z,al) {xk^-zfll-z*) l^xk,,-z,z*) 

- + -fT—n-f 


\\Xkr, 




\\xk„ 


^ (Xfc„ -z,alj 

Ikfcn - ^^11 

Ikll 

\\XkJ 

IkfcJI 


^ (xfc„ -z,alj 

- cr z*|| ^1 + 

Pll 


Ikfeoll 

—>■ + 00 , 




(2.32) 


and we reach a contradiction. □ 
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Corollary 2.10 Let X be a reflexive real Banach space such that X f {0} and let M: X 2^* be 
coercive. Then M~^ is bounded. 

Proof. Take Mi = M and M 2 = 0 in Lemma 2.9. □ 

Proposition 2.11 Let X be a reflexive real Banach space such that X {0}, let h E ro(d:’) be 
essentially smooth, and let M: X ^ 2“^* be such that dom M n int dom h f 0. Suppose that one of 
the following holds: 


(i) 

(ii) 


dom M n int dom h is bounded. 

There exists z E dom M n int dom h such that 

. Ax - z, Mx) 
iim mi- 77 -= + 00 . 

||a:||—>-+oo X 


(2.33) 


(iii) M is uniformly monotone at a point z E dom M n int dom h with a supercoercive modulus. 

(iv) M is monotone and h is supercoercive. 

(v) M is monotone and h is uniformly convex at a point z E dom M n int dom h, i.e., there exists an 
increasing function [0, +oo[ —[0, + 00 ] that vanishes only at 0 such that 

(Vy E dom/ i)(Vq; E ]0,1[) h{ay+{l — a)z)+a{l — a)4>{\\y — z\\) ^ ah{y) + {l — a)h{z). (2.34) 
Then Vh + M is coercive. If in addition, M is maximally monotone, then dom {Vh + M)~^ = X*. 


Proof. We first observe that [35, Theorem 18.7] and [6, Theorem 5.6] imply that V/i is maximally 
monotone and that domVh = int dom h. 


(i) : Lemma 2.7(i). 

(ii) ; It follows from Lemma 2.8 that V/i + M is coercive. 

(iii) : Since Vh + M is uniformly monotone at z with a supercoercive modulus, the claim follows 
from Lemma 2.7(ii). 


(iv); Let z E domM n int dom h = domM n domdh. Then we derive from (2.26) that 


(x — z, Vh(x)) 

hm ^ ^ = + 00 . 

|| ic ||— ^“|~00 ^ 


(2.35) 


Thus, Vh satisfies (2.27) and it follows from Lemma 2.8 that V/i + M is coercive. 


(v); It follows from [39, Definition 2.2 and Remark 2.8] that Vh is uniformly monotone at z 
with a supercoercive modulus. Hence, Vh + M is likewise and Lemma 2.7(ii) implies that V/i + M 
is coercive. Alternatively, this is a special case of (iv). 
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Finally, suppose that M is maximally monotone. Then [35, Theorem 24.1(a)] asserts that V/i + 
M is maximally monotone. Consequently, since V/i+M is coercive, it follows from [42, Corollary II- 
B.32.35] that dom (V/i + M)-^ = ran (V/i + M) = d:”*. □ 

Lemma 2.12 Let X and y be real Banach spaces, let D c X be a nonempty open set, and let C be a 
nonempty bounded convex subset of D. Suppose that T: D ^ y is uniformly continuous on C in the 
sense that 

(V£ G ]0,+oo[)(35 € ]0,+oo[)(Vx G C')(V7/G C) ||x — y|| ^ 5 => ||Tx — Tt/H ^ e. (2.36) 
Then T is bounded on C. 

Proof. In view of (2.36), there exists <5 G ]0, +cx)[ such that 

(VxGC)(V 2/GC) ||x-y|K5 ^ llTx-TyKl. (2.37) 

Now fix z G C and p G ]0, +oo[ such that C C. {x G Af | ||x — z|| ^ p}, and take an integer m ^ 
1 + p/5. Let X € C and set 

Tl 

(Vn G {0,..., m}) = x H- (z — x) € C. (2.38) 

m 

Then, for every n G {0, ...,m — 1}, ||xn+i — x„|| = \\z — x\\/m ^ p/m ^ 5 and (2.37) yields 
||Tx„+i — Txn\\ ^ 1- Hence, \\Tz — Tx\\ ^ \\Txn+i — Txn\\ ^ m and therefore ||Tx|| < 

||Tz|| + m. We conclude that sup^^g,^ < \\Tz\\ + m. □ 


3 Best Bregman approximation algorithm 

Proposition 2.1(i)(a) asserts that Problem 1.2 reduces to finding the Bregman projection of a ref¬ 
erence point (xo,?/o) the closed convex subset C = Z n dom / of dom/. Our strategy is to 
employ Proposition 2.5 for this task. The following condition will be used subsequently (see [7, 
Examples 4.10, 5.11, and 5.13] for special cases). 

Condition 3.1 [8, Condition 4.3 (ii)] Let X he a reflexive real Banach space and let h G ro(A:’) 
be Gateaux differentiable on intdom/i / 0. For every sequence (x„)„gM in intdom/i and every 
bounded sequence {yn)nm in intdom/i, 

{Xni Vn) ^ 0 Xfi Dn ^ 0. (3.1) 

We now derive from Proposition 2.5 our best Bregman approximation algorithm to solve Prob¬ 
lem 1.2. 

Theorem 3.2 Consider the setting of Problem 1.2. Let h G ro(A:’) and j G ro(/’) be Legendre functions 
such that intdom/ c intdomh, L(intdom/) c intdomj, and there exist e and 5 in ]0, +oo[ such 
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that V/i + eA and Vj + 6B are coercive. Let a € [max{e, 5 }, +oo[ and iterate 

for n = 0 , 1, ... 

{ln,hn) G [e,cr] X [( 5 , 0 -] 

an = (v/i + 7„^)"^(v/i(xn) - 'ynL*y*) 

< = 7n^(V/l(Xn) - V/l(On)) - 

fen = (Vj + fInB)~^{S/j{LXn) + ^nVl) (3.2) 

fen = “ Vj(6n)) + Vn 

Hn = {(x,y*) G I {x,al + L*h*n) + {bn - Lan,y*) < {an,a*n) + {bn,b*n)} 

( 3 ^n+l/ 2 ) yn+ 1 / 2 ) ~ ^H„i^n,yn) 

_ iXn+l,yn+l) = QmXO,yo),iXn,yn),iXn+l/ 2 ,yn+l/ 2 ))■ 

Then the following hold: 

(i) Let n € N. Then the following are equivalent: 


(a) 

i^n 1 

y*n) = {x,r)- 

(b) 


y*n) G 

(c) 


yn) G Hn- 

(d) 

Xn = 

= an and y* = b*n. 

(e) 

Ldn 

= bn and a*n = -L*b*n. 

(f) 

Hn 

= X. 

(g) 

{Xn+l/2,y*n+i/2) = {Xn,y*n)- 

(h) 

{Xn+l^yn+l) — {Xn,yn)- 


(ii) Y.neN^^i^n+l,Xn) < +00 and iVn+l^yn) < +00- 

(iii) YneNDHxn+l/2,Xn) < +OOandYn€ND^*iyn+l/2^yn) < +00- 

(iv) Suppose that f, g*, h, and j satisfy Condition 3.1, and that Vh and Vj are uniformly continuous 
on every bounded subset of int dom h and int dom j, respectively. Then > x and y* -^y*. 

Proof. We apply Proposition 2.5 to 

C = Zndom/. (3.3) 

It follows from Proposition 2.1 (i) (a) and our assumptions that C is a closed convex subset of dom f 
and that C n int dom/ / 0 . Moreover, Proposition 2.2(i) asserts that / is a Legendre function. 
Now let 7 G [e,+oo[ and let p G [<5,+oo[. Since h is strictly convex, Vh is strictly monotone 
[40, Theorem 2.4.4(ii)] and Vh + 7^4 is likewise. Let {x*,xi) and (x*,X 2 ) be two elements in 
gra(V/i + 7 ^)“^ such that xi X 2 . Then (xi,x*) and (x 2 ,x*) lie in gra(V/i + yA) and the strict 
monotonicity of Vh + yA implies that 

0 = (xi — X2, X* — x*) > 0, (3.4) 
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which is impossible. Thus, 


(V/i + 7 ^)”^ is at most single-valued. (3.5) 

The same argument shows that 

(Vj + is at most single-valued. (3.6) 

On the other hand, by assumption, there exists {x,y*) G ZD intdom/. It follows from (1.9) that 
X G domA and Lx G domB. Furthermore, (2.12) yields x G intdom/. Therefore 

{ X G dom A n int dom f c dom A n int dom h 

(3.7) 

Lx G domil n L(intdom/) c domU n intdom/. 

Thus, dom A n int dom h ^ 0 and dom B n int dom/ ^ 0. It therefore follows from Lemma 2.8 that 
V /1 + 7A = (V/i + eA) + (7 —e)A and V/+ pil = (V/+ (5i?) + (^ — <5)11 are coercive. (3.8) 
Altogether, (3.5), (3.6), (3.8), and Proposition 2.11 assert that the operators 


|(V/i + 7 A) ^: A* —domA n intdom/i (3 9 ) 

\ (V/ + yB)~^: 3^* ^ domil n intdom/ 

are well defined and single-valued. Now set 

(VnGN) Xn = {Xn,yn) and Xn+112 = {Xn+ll2,yn+ll2)- (3.10) 

Since (3.2) yields 

(VnGN) (an,a*)GgraA and {bn,bl)GgraB, (3.11) 

it follows from (3.3), Proposition 2.1(ii)(b), (3.2), and Definition 2.3 that 

(VnGN) 0^C (ZZ cHn = Hf{xn,x^+y2)- (3-12) 

Hence, appealing to Proposition 2.2(i) and (1.5), we see that 

(VnGN) P^j : int dom / —> n int dom / (3.13) 

and that 

(Vn G N) Xyi-\-\ — ■ (3.14) 


Thus, we derive from (3.10), (3.12), and Proposition 2.5(ii) that {xn)n&n and (yj^)nGN are well- 
defined sequences in intdom / and int dom 5 *, respectively. 

(i) : We prove the following implications. 

(i)(a)=>(i)(b): Clear. 
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(i)(b)^(i)(a): Proposition 2.5(iii). 

(i)(b)^(i)(c): Clear by (3.12). 

(i)(c)^(i)(d): In view of (3.2), 

0 ^ (x„, < + L*bl) + (6„ - Lan, yl) - {an, a^) - {bn, b^) 

= {Xn - an,al + L*y*) + {LXn - bn, bl - yl) 

= ln'^{Xn - an,Vh{Xn) “ Vh{an)) + IJL~^ {LXn “ bn,Vj{LXn) “ ^j{bn))- (3.15) 

Consequently, the strict monotonicity of V/i and Vj yields 

Xn = On and LXn = bn- (3.16) 

Furthermore, 

K = f-tn"{Vj{LXn) - Vj{bn)) + yl = yn\Vj{bn) - Vj{bn)) + y*n = y^ (3.17) 

(i)(d)^(i)(e): We derive from (3.2) that = j-\Vh{xn)-yh{an))-L*y*^ = -L*y* = -L*b*^. 
On the other hand, since 

{Lcin bn,^j{Lcin) ^j{bn}) — {LXn bn,^j{LXn) ^j{bn')) 

— ian{LXn bn,b^ 

= 0, (3.18) 

the strict monotonicity of Vj yields Lun = bn- 
(i)(e)-^(i)(f): Proposition 2.1 (ii)(a). 

(i)(f)^(i)(g): Indeed, = Xn- 

(i) (g) => (i) (h) : We have 

Xn+l = Q^{xo, Xn, a;„+i/ 2 ) = pfit(xo,x^)nHf {xn,Xn+i/ 2 )^^ ^ ^Hf(xo,Xn)^^ ^ (3-19) 

(i)(h)^(i)(g): By Proposition 2.5(v), 0 ^ Df {Xn+i/ 2 ,Xn) ^ Df{xn+i,Xn) = 0. Therefore 
{xn+i/ 2 , Xn) = 0 and we derive from [6, Lemma 7.3(vi)] that Xn+\i 2 = ®n- 

(i)(g)^(i)(c): Indeed, Xn = aJn+ 1/2 = Pfi^Xn G Hn- 
(i)(d)=>(i)(b): We derive from (3.2) that 

Vh{Xn) - lnL*yn G V/l(o„) + yn^On = V/l(x„) + ^n^Xn- (3.20) 

Hence —L*y)^ G Axn- Likewise, as in (3.18), we first obtain Lxn = bn and then 

Vj(LXn) + Mnyn G Vj(bn) + fJ-nPhn = Vj{LXn) + IJ,nB{LXn)- (3.21) 
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Thus, y* G B{Lxn), i.e., Lx„ G B In view of (1.9), the implication is proved. 

(ii): Proposition 2.5(iv) yields 

"^D^iTn+l^Xn) + = '^Df{Xn+l,Xn) < +00. (3.22) 

nSN nCN nCN 

(hi): Proposition 2.5(vi) yields 

^ D^{Xn+l/2,Xn) + ^ D^* (yn+l/2> l/n) = {Xn+l/2, Xn) < +00. (3.23) 

ttGN nGN ttGN 

(iv): Proposition 2.5(ii) implies that (a;^),^^^ is a bounded sequence in intdom/. In turn, 
(a^n)nGN £ (intdom/)^ and (y*)„gN G (intdomy*)^ are bounded. (3.24) 

On the other hand, by (3.2), 


(Vn G N) 

{Xn+l/2, yn+ 1 / 2 ) ~ ®n+l/2 = C Hn 

(3.25) 

and 

(Vn G N) 

{Xn+1/2, a*n + L*b*J + (bn - LUn, y^+i/a) = {an, a*n) + {bn, b*n). 

(3.26) 

Therefore, 

(Vn G N) 

Ikn - Xn+l/ 2 \\ l|a; + L*bl\\ + 116,, - LanW hi - yl+l/2\\ 

^ {Xn ~ Xn+\/2, an + ^ bn) + {bn ~ Lttn, yn ~ yn+l/ 2 ) 

= {Xn,al + L*b*J + {bn - Lan, yl) - {an, a*n) - {bn, b*n) 



= {Xn - 0„, a* + L*y^) + {LXn -bn,h*^- Vn) 

= ^~^{Xn - an,Vh{Xn) “ Vh{an)) + H~^{LXn “ 6n, Vj(TXn) - Vj{bn)) 

^ a~^{D^{Xn,an) +D^{an-,Xn) + D^{LXn,bn) + {bn, LXn)) 

^ {D\xn, an) + D^Lxn, bn)) ■ (3.27) 

However, since (iii) yields 

^■^(a:n+i/ 2 ,a;n) ^ 0 and ^ 0 (3.28) 

and since / and g* satisfy Condition 3.1, (3.1) yields 

3;n+l/2 — Xn ^ 0 and yn+1/2 ~ Vn ^ (3.29) 

Since V/i is uniformly continuous on every bounded subset of intdom/i. Lemma 2.12 asserts that 
Vh is bounded on every bounded subset of intdom/i and hence, since intdom/ c intdom/i and 
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L* is bounded, it follows from (3.24) that {Vh{xn) — 1nL*yn )is bounded. We therefore deduce 
from (3.9), (3.2), and Lemma 2.9 that 

(on)neN £ (intdom/i)^ is bounded. (3.30) 

Similarly, since Vj is uniformly continuous on every bounded subset of int dom j and L(int dom /) c 
intdomj, it follows from (3.24) and Lemma 2.12 that (Vj(Lx„) + ynyn)n£f<} bounded and hence 
(3.9), (3.2), and Lemma 2.9 yield 

(('n)nGN € (intdomj)^ is bounded. (3.31) 

Thus, (V/i(xn))neN, (V/i(an))nGN, (Vj(Lxn))nGN, and {Vj{bn))n&n are bounded and we deduce 
from (3.2) that 


(a*)„6N and {b*JneN are bounded. (3.32) 

We therefore derive from (3.27), (3.29), (3.30), and (3.31) that 

D^{xn,an) —)• 0 and D^{Lxn,bn) —^ 0. (3.33) 

Since h and j satisfy Condition 3.1, we get 

Xfi — clyi —^ 0 and Lx^i — bji —y 0. (3.34) 

Therefore, since V/i is uniformly continuous on every bounded subset of int dom /i and Vj is uni¬ 
formly continuous on every bounded subset of intdomj, 

V/i(xn) — V/i(a„) —)■ 0 and Vj(Lx,i) — Vj(6n) —> 0. (3.35) 

Hence, using (3.2), we get 

a; + L*yl 0 and b^-y^^ 0. (3.36) 

Now, let X = (x, y*) G 2U(xn)nGN> say ^ x. Then Xk„ x and y^ y*, and we derive from 
(3.34) and (3.36) that 




and 


at +L*bl ^0. 


(3.37) 


It therefore follows from (3.11), Proposition 2.1(iii), and (3.24) that x G Z n dom/ = C. Hence, 
we derive from Proposition 2.5(vii) that 

D^{xn,x) + D3*{y*^,r) = Df{xn,x) ^ 0, (3.38) 

where x = (x,y*). Hence, {xn-,x) 0, D^* {y^,y*) —> 0, and, since / and g* satisfy Condi¬ 

tion 3.1, we conclude that x^, —^ x and y* y*. □ 


Remark 3.3 We provide a couple of settings that satisfy the assumptions of Theorem 3.2. 
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(i) In Problem 1.2, suppose that X and y are Hilbert spaces, that / = || • |P/2, and that g = \\- |P/2. 
Furthermore, in Theorem 3.2, set h = f and j = g, and note that, for any e e ]0,+oo[, 
S/h + eA = Id +eA and Vj + eH = Id +eB are strongly monotone and hence coercive by 
Lemma 2.7(ii). Then we recover the framework of [3], which has been applied to domain 
decomposition problems in [4] . 

(ii) Let and {^ 2 ,J^ 2 ,g- 2 ) be measure spaces, let p and q be in ]l,+oo[, and set 

P* = p/{p — 1) snd q* = q/{q — 1). In Problem 1.2, suppose that X = LP(Hi, /ri), 

= L^{^ 2 .F 2 ,P 2 ), / = II • r/p, and g = \\ - p/q. Then A”* = LP*(L!i, = 

L^* {^l 2 ,X 2 , P 2 ), and g* = \\ ■ P*/q*- Moreover, it follows from Clarkson’s theorem [17, The¬ 
orem 11.4.7] that X, X*, y, and y* are uniformly convex and uniformly smooth. Hence, 
we derive from [6, Corollary 5.5 and Example 6.5] that /, g, and g* are Legendre functions 
which are uniformly convex on every bounded set, and which therefore satisfy Condition 3.1 
by virtue of [7, Example 4.10(i)]. Now set h = f and j = g in Theorem 3.2. We derive 
from [17, Theorem IL2.16(i)] that Vh and Vj are uniformly continuous on every bounded 
subset of X and y, respectively. In addition, h and j are supercoercive and therefore, for any 
e G ]0, +oo[. Proposition 2.11(iv) asserts that V/i + eA and Vj + eB are coercive. Einally, it 
follows from [17, Proposition 11.4.9] that Vh: x i-G |x|^’“^sign(x) and Vj:y^ |y|^“^sign(y). 

Remark 3.4 The implementation of algorithm (3.2) requires the evaluation of the operator {Vh + 
A)~^. We provide a simple example in the Euclidean plane of a maximally monotone operator 
A for which {Vh + A)~^ can be computed explicitly, whereas the classical resolvent (Id +A)~^ is 
difficult to evaluate. Let /? G ]0, + 00 [ and let V’: K —)• M be a Legendre function with a /3 Lipschitz- 
continuous derivative. Set 

71: m 2 ^ m 2 . + (3.39) 

and 

h: m 2 ]-oo,+oo] : (Ci, 6 ) ^ V’( 6 ) + V'( 6 ). (3.40) 

Then it follows from [9, Theorem 18.15] that A is the sum of the gradient of the convex function 
( 6 , 6 ) /3^?/2-V'(6) + /3^i/2-'!/’(6) and of the skew linear operator ( 6 , 6 ) ^ (- 6 , 6 )- Thus, 

4 is a maximally monotone operator [9, Corollary 24.4] which is not the subdifferential of a convex 
function. In addition, as in Proposition 2.2(i), h is a Legendre function and 

(v(6,6 ) gk2 ) (vh + 7 l)-i(a, 6 ) = 

Remark 3.5 At every iteration n, algorithm (3.2) requires the computation of y^) 

and then of {{xo,yp),{xn,yn):{xn+i/ 2 ,yn+i/ 2 ))- Sets; = (a; + - Lun), 

Pn = {an^apj + {bn,b*P, and Xn = [xn^yp), Then, if Xn 0 Hn, Xn+ 1/2 is the Bregman projec¬ 
tion of Xn onto the closed affine hyperplane {a; G X | {x,sp = Pn}- Thus, is the solution of 

the problem 


(3.42) 


minimize f{p)-{p,Vf{xn)) 

{P<0=Vn 
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which, using standard first order conditions, is characterized by (see also [5, Remark 6.13] and [16, 
Lemma 2.2.1]) 

'V/(®„+i/ 2 ) = Vf{Xn) - As* 

^ {Xn+1/2, K) = (3.43) 

_ A G ]0, +oo[. 

In view of [6, Theorem 5.10], the Lagrange multiplier A is uniquely determined by the equation 
{Vf*{Vf{xn) — As*),s*) = r]n. The problem therefore reduces to finding the solution A to this 
equation in ]0,+cx3[ and then setting x^+^j^ = V/*(V/(a;„) — As*). Likewise, it follows from 
(2.15) that Xn+i is the unique solution to the problem 


minimize 

(p-a:„,V/(a!o)-V/(£c„))!£0 

(p-a:„+l/2,V/{a;„)-V/{a;„+i/2))<0 


f{p) - (P, V/(®o)). 


(3.44) 


Depending on the number of active constraints, this problem boils down to determining up to two 
Lagrange multipliers in ]0, +oo[. 


Next, we consider a specialization of Problem 1.2 to multivariate structured minimization. 


Problem 3.6 Let m and p be strictly positive integers, let (4:i)i<gj^m and (3^fc)is£fc^p be reflexive real 


Banach spaces, and let X be the standard vector product space 'X,-^^Xij x j equipped 

with the norm 


{yk)l^k^p) 


A E 11^*11'+ E 

\ i=i 


fkW^- 


(3.45) 


k=l 


For every i G {l,...,m} and every k G {l,...,p}, let pi G ro(4::’j), let 'ijjk G ro(3^fc), and let 
Lfcj '■ Xi ^ be linear and bounded. Consider the primal problem 


minimize V tpi{xi) + V V'fc ( LkiXi ), 

^=l k=l 1=1 


(3.46) 


the dual problem 


m 


minimize 

i=l 




k=l 


+ ^rk{yl\ 


(3.47) 


k=l 


and let 

Z={{x,y*)^X 


t' 

(Vi G {1,... ,m}) -J2^liyk^d(pi{xi) and 

m X 

(VA: G {1,... ,p}) & dif^liyDi (3.48) 

1=1 ^ 
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be the associated Kuhn-Tucker set. For every i G {1,..., m}, let fi G ro(d:’j) be a Legendre function 
and let Xi^ G intdom/j. For every k G ,p}, let gk G ro(3^fc) be a Legendre function and let 

0 G intdomy*. Set xq = vl = and 

m p 

f : X ^ ]-oo,+oo] : (x,y*) ^ + '^gl{yl), (3.49) 

i=l k=\ 

and suppose that Z n intdom/ / 0. The objective is to find the best Bregman approximation 

{vDi^k^p) = Pzi^o^Vo) to (xo,yS) from Z. 


We derive from Theorem 3.2 the following convergence result for a splitting algorithm to solve 
Problem 3.6. 


Proposition 3.7 Consider the setting of Problem 3.6. For every i G m}, let hi G ro(<Ti) 

be a Legendre function such that intdom/j c intdom/i* and hi + Ci^pi is supercoercive for some 
Ei G ]0,+oo[. For every k G p}, let jk G ro(3^fc) be a Legendre function such that 

E™ifrH(intdom/i) C intdomjfc and jj. + dktpk fr supercoercive for some 5k G ]0,+oo[. Set 
e = maxi^j^rn tmd 5 = maxi^^^p 5k, let a G [max{e, J}, +cx3[j and iterate 


for n = 0,1 ,... 

(7n, Ain) G [£,er] x [<5, a] 
for i = 1,... ,m 

Oi^n = (VAlj + yridpi) ^ (^hi{xi^n) ~ In 

®i,n ~ 7n ^iyhi{xi^n) — ^hi{ai^ri)) “ ^XiVk^n 

for k = 1,... ,p 

bk,n ~ jk T Pnd'fkj) (f^jk{^jji=i LkiXi^n) T hnUk^n) 

^k,n ~ Pn^ jk{Yli=l ^kiXi,n) “ '^jk{bk,n)) + 

tk,n — ^fc,n Xyi=l ^kiOi^n 

for i = 1,... ,m 


— r,* J- S^P T* h* 
^i,n ^i,n 2-^k=l ^ki^k,r 


hn — Yli=l{^i,n: eii „) + Z]fc=ln) 


Hn = 




G A' 

— p/ 


+J2l=l{tk,n,y*k) ^ Pn] 


{Xn+l/2,yn+i/2) = PLS^n^yl) 

(xn+1, y;+i) = Q^((a;o, yl), ixn,yl), iXn+l/2,yn+l/2)) > 


(3.50) 


where we use the notation (Vn G N) x„ = {xi^n)i^i^m tmd y* = {vl n)t^k^p- Suppose that the 
following hold: 


(i) For every i G {!,... ,m}, fi and hi satisfy Condition 3.1 and SI hi is uniformly continuous on 
every bounded subset of int dom hi. 

(ii) For every k G {1,... ,p}, gl and jk satisfy Condition 3.1 and S/jk is uniformly continuous on 
every bounded subset of int dom jk. 
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Then 


(Vz € {1,... ,m}) Xi^n^Xi and (VA: G {1,... ,p}) yl^n^vl- (3.51) 

Proof. Denote by X and y the standard vector product spaces and equipped with 

the norms x = {xi)i^i^rn ^ \/ES1NP ^^d y = {yk)i^k^p ^ y^ELi WVkF^ respectively. Then 

X* is the vector product space X™ equipped with the norm x* i-> Ik? IP y* is the 

vector product space equipped with the norm y* \JY%=i Ily^P- Let us introduce the 

operators 

'A: X -)■ 2^*: x X™i5y>i(xi) 

< B: y ^2^*: y>-^ Xl^;^d'il’k{yk) 

L: X ^ y-. x ^ { E^i LkiXi) 

and the functions 

f: X ^ ]-oo,+oo] : x ^ Ya=i 
h: X ^ ]-oo, +oo] : x YlT=i hi{xi) 

< (p: X ^ ]-oo,+oo] : x i-G 
g-.y^ ]-oo,+oo] : y ^ Ylk=i9k{yk) 

J-y ^ ]-oo,+oo] : y ^ Yfk=i9k{yk)- 

Then it follows from [40, Theorem 3.1.11] that A and B are maximally monotone. In addition, the 
adjoint of L is L*: y* ^ X* : y* (Efc=i and, as in Proposition 2.2(i), / and g are 

Legendre functions. Thus, Problem 3.6 is a special case of Problem 1.2. Furthermore, h and j are 
Legendre functions, 

m m 

intdom/= Xintdom/jC X intdomhj = intdomh, (3.54) 

i=l i=l 


(3.52) 


(3.53) 


and 


pm p 

L(intdom/) = X Lkijint dom /*) c X intdomjfc = intdom j. (3.55) 

k=l k=l 

Next we observe that, for every i € {1,. .., m}, since hi + e(pi is supercoercive, (hi + etpi)* is bounded 
above on every bounded subset of Xf [6, Theorem 3.3]. As a result, {h + e(f)*: x* + 

e(fi)*{x*) is bounded above on every bounded subset of X*, and it follows from [6, Theorem 3.3] 
that h + ey> is supercoercive. In turn since, as in (3.7), 0 / dom A n int dom / c dom ip n int dom /, 
we derive from [40, Theorem 2.8.3] and Lemma 2.7(iii) that 

Vhy £A = Vh + edip = d{h + Eip) (3.56) 
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is coercive. We show in a similar fashion that Vj + 6B is coercive. Now set, for every n € N, 

and — (bf^ ^iji^k^p- Then, for every n (E N, 

we have 

(Vi G {1,... , m}) ai^n = + -ind^i)~^ i ^hi{xi^n) - 7n ^ Ll^yl ,^ 

^ k=l 

P 

77 (Vi G {1, . . . , W,}) ^hii^Xi^n) 7n ^ ^ ^kiVkjn ^ ^^i(Qi,n) “f 7r*^V^*(®*,»i) 

fc=l 

77 V/l(Xn) - 7n-T*2/* G Vh{an) + 7n^an 

^ o„ = (v/i + 7n^)"^ (V/i(x„) - 7 nT* 2 /:). (3.57) 

Likewise, 

(VnGN) hn = {Vj + ynB)-\Vj{Lxn) + yny*n). (3.58) 

Thus, (3.50) is a special case of (3.2). In addition, it follows from our assumptions and (3.53) 
that /, g*, h, and j satisfy Condition 3.1, and that V/i and Vj are uniformly continuous on every 
bounded subset of intdomh and intdomj, respectively. Altogether, the conclusions follow from 
Theorem 3.2(iv), with x = {xi)i^i^rn and y* = {yl)ii:k^p. □ 


Remark 3.8 In Problem 3.6, suppose that, for every i G {l,...,m} and every k G 
ipi and ijjk are supercoercive Legendre functions satisfying Condition 3.1, that Vtpj and 
are uniformly continuous on bounded subset of intdom(pj and intdom^^j., respectively, and 
that ^ Lfcj(intdom<pj) c intdomV’fc- Then, in Proposition 3.7, we can choose, for every 
i G {1,... ,m} and every A: G {1,... ,p}, hi = ipi and jk = V’fcj and in (3.50), we obtain 


‘ Vh{x,,n)-lnY.Ll^yl, 


Ojj..' 


= Vh* 


k=l 


1 + 7n 


(3.59) 


and 


bk,n = Vfk 


. m , 

^ jki ^ ^ Lki^i^n ] “f hnUk^r 

^ i=l ' 


1 + /^n 


(3.60) 


For example, suppose that, for every i G {1,..., m} and every k G {1,... ,p}, A) = M, 3^^ = R, and 
Pi = hi is the Hellinger-like function, i.e.. 


(pi : R —> ]—cxD, +c»] : Xi i-T- 



if Xi G [-1,1]; 

otherwise. 


(3.61) 
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Then (3.59) becomes 



(3.62) 


Furthermore, as shown in the next section, in finite-dimensional spaces, we can remove Condi¬ 
tion 3.1 and the assumption on the uniform continuity of {V(pi)i^i^rn and {'V'4>k)i^ki^p- 


4 Finite-dimensional setting 


In finite-dimensional spaces, the convergence of algorithm (3.2) can be obtained under more gen¬ 
eral assumptions. To establish the corresponding results, the following technical facts will be 
needed. 

Lemma 4.1 Let X be a finite-dimensional real Banach space and let f eTo{X) be a Legendre function. 
Then the following hold: 

(i) / and V/ are continuous on intdom/ [9, Corollaries 8.30(iii), 17.34, and 17.35]. 

(ii) V/: intdom/ —> intdom/* is bijective with inverse V/*: intdom/* ^ intdom/ [6, Theo¬ 
rem 5.10]. 

(hi) Let X G intdom/, let y G dom/, and let (yn)neN C (intdom/)^. Suppose that Vn ^ U atid that 
(H-^ {x,yn))n£n is bounded. Then y G intdom / and {y,yn) 0 [5, Theorem 3.8(ii)]. 

(iv) Let X G intdom/, let y G intdom/, let {xn)n&'N C (dom/)^, and let (yn)neN C (intdom/)^. 
Suppose that (x„, yn) —> 0. Then x = y [5, Theorem 3.9(iii)]. 

(v) Let y G intdom/. Then {■,y) is coercive [6, Lemma 7.3(v)]. 

(vi) Let {x,y} C intdom/. Then D^{x,y) = D^*{Vf{y),Vf{x)) [6, Lemma 7.3(vii)]. 

Proposition 4.2 In Problem 1.2, suppose that X and y are finite-dimensional. Let h G ro(Af) and 
j G ro((F) be Legendre functions such that intdom / c intdomh, L(intdom/) c intdomj, and there 
exist e and 6 in ]0, -|-(X)[ such that Vh + eA and Vj + 6B are coercive. Let a G [max{e, h}, +00 [ and 
execute algorithm (3.2). Then {xn-,yf) ifS,y*). 


Proof. Set C = Z n dom f. We first observe that, as in (3.24), 

(xn),igN C (intdom/)^ and (y*),igFj G (intdom 51 *)^ are bounded. (4.1) 
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In addition, we deduce from (3.10), (3.14), and Proposition 2.5(i) that x = {x,y*) E C C 
flriGN (® 0 ) Xn), and hence from (2.14) that 

(VnEN) Df{x,Xn) + DS\r,yn) = Df{x,Xr,) ^Df{x,xo). (4.2) 

By virtue of Proposition 2.5(vii) and (4.1), it suffices to show that every cluster point of (x„, y^)neN 
belongs to Z. To this end, take x ^ X,y* ^y, and a strictly increasing sequence (A;n)ngN in N such 
that Xk^ X and y^^ —> y*. Then Lxk„ Lx, x E dom/, and y* E domg'*. Since x E intdom/ 
and since (4.2) implies that (Zl-f(x,Xfc„))„gN is bounded, it follows from Lemma 4.1(iii) that x E 
intdom/. Analogously, y* E intdom 5 *. In turn. Lemma 4.1(i) asserts that 

V/K)^V/(x) and Vg*{y*J ^Vg*{y*). (4.3) 

Furthermore, since intdom/ c intdom/i and L(intdom/) c intdomj, we obtain x E intdomh 
and Lx E intdom/. Thus, there exists p E ]0,+oo[ such that B{x;p) C intdom/i and B{Lx;p) C 
intdom/. We therefore assume without loss of generality that 

(xk„)neN ^ L(x;p)^ and (Lxk„)neN ^ B(Lx; p)^. (4.4) 

In view of Lemma 4.1(i), h{B{x;p)) and Vh{B{x-, p)) are therefore compact, which implies that 
{h{xk„))nm and iVh{xk„))n&n are bounded. Hence {D^{x,Xk„))nm is bounded and, moreover, it 
follows from (3.2), (4.1), Lemma 2.9, and (3.9) that {ak,,)nm is a bounded sequence in intdom/i. 
We show likewise that {D^Lx, Lxk„))n£N and {bk„)nen are bounded. Next, since the convexity of 
h yields 

(Vn E N) D^{x,akJ = h{x) - h{ak^) - {x - ak„,Vh{akJ) 

= h{x) - h{xkj - {x - Xk,„Vh{xkJ) + {x - ak„,Vh{xkJ - ^h{akj) 

- {Ha-kJ - KxkJ - {ak„ -Xfc„,V/i(xfc„))) 

< D’^{x,xkj + {x - ak„,Vh{xk„) - Vh{akJ), (4.5) 

we derive from (3.2) that 

(Vn E N) a-^D^{x,akJ ^ 7k^D^ix,akJ 

^ e“^Il'^(x,Xfc„) + (x-afc„,7fc„^(V/i(xfc„) - V/i(afc„))) 

= e-^D^{x,Xk„) + {x- ak„,a*k^ + L*ylJ 
= e~^D’^{x,XkJ + {x- ak„,a*k^ + L*y*) 

+ {Lx-Lak„,y*k^-y*). (4.6) 

Similarly, 

(Vn E N) a-^D^{Lx, bkj ^ 6-^D^{Lx, LxkJ + {Lx - bk„,bl^ - ylj 

< 6~^D\Lx,LxkJ + {Lx-bk„,bl^ -y*) 

+ {Lx-bk„,r-yV- ( 4 . 7 ) 
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Since (3.12) entails that 

® gCc fl = n {ix,y*)eX\{x-ak„,al^+L*y*) + {Lx-bk„,bl^-y*)^0}, (4.8) 

neN nCN 

we deduce from (4.6) and (4.7) that 

(Vn € N) a~^{D^{x,akJ + D^{Lx,bkJ) 

^ e~^D'^{x,XkJ+ d~^D^{Lx,LxkJ + {Lx - Lak„,yl^ -T) + {Lx-bk„,y* - ylj 
= e~^D’^{x,XkJ + S~^D^Lx,Lxk„) + {bk^ - Lak„,y*k^ -V*) 

^ e-^D’^{x,Xk„) + 5-^D\Lx,Lxk„) + {\\bkj + \\L\\ ||afc„||)(||yfc^|| + ||y*||). (4.9) 

Hence, the boundedness of (nfc„)n£Nj (^fcn)^^sN> (2/fc„)nsNj {L) (x,Xk„))neNy nnd (D^(Lx, Lxk„))nGN 
implies that of {D’^{x, ak„))neN and {D^{Lx, bk„))ne'N- In turn, by Lemma 4.1(vi), 

(^D^* ['Vh{akJ,S/h{x))'j and (^D^* ['Vj{bkJ,Vj{Lx))'j are bounded (4.10) 

and, since Lemma 4.1(v) asserts that D’^* {■, Vh{x)) and Vj{Lx)) are coercive, it follows from 
(4.10) that {Vh{akJ)nm and (Vj(6fc„))neN are bounded. Thus, since {yl^n^n, (V/i(a:fc„))nGN and 
(yj{Lxkn))nm are bounded, we infer from (3.2) that 

(aljnm and {bljnm are bounded. (4.11) 

On the other hand, since (3.12) yields ® G C C flnsN ®fc„+i/ 2 )> (2.14) and (4.2) imply 

that 

(Vn G N) {x,Xk„+i/2)+D^* {y\y*k^+i/ 2 ) = {x,Xk^+i/ 2 ) ^ Df{x,Xk^) ^ Df{x,xo). (4.12) 

Thus, Lemma 4.1 (vi) yields 

(Vn G N) Il^*(V/(xfe„+i/ 2 ), V/(x)) + {S/g*iyl^,/,),Vg*{r)) 

= Df{x, Xk^+1/2) + D 3 * (r , yL+1/2) 

^Df{x,xo) (4.13) 

and, since D^* {■, V/(x)) and {■ yg*(jj*)) are coercive by Lemma 4.1(v), it follows that 

(V/(xfc„+i/ 2 ))nGN and {S /are bounded. (4.14) 

However, as in (3.28), {xk^+i/ 2 -,Xkri) 0 and D3*{y* II’ therefore follows 

from Lemma 4.1 (vi) that 

^^*(V/(xfcJ, V/(xfc„+i/ 2 )) ^ 0 and {S/g*{yl)yg*iyl^,/,)) ^ 0. (4.15) 

In view of Lemma 4.1 (iv), we infer from (4.3), (4.14), and (4.15) that there exists a strictly increas¬ 
ing sequence {pk„)n& in N such that 

V/(xp,^+i/ 2 )^V/(x) and S/g*^ Vg*{y*). (4.16) 
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Since, by Lemma 4.1(i)-(ii), (V/) ^ = V/* is continuous on intdom/* and (S/g*) ^ = S/g is 
continuous on intdom( 7 , we obtain Xp^ + 1/2 —> x and y*^ ^^^2 ^ V*- Thus, 

^Pfe„+i /2 “ 0 and - 2/pfe„ ^ 0- (4.17) 

On the other hand, as in (3.27), 

(Vn £ N) ||x„, - + L-6;._ || + - La,., 1| H,,;., - 

^ (T (Z) {xp^^,ap^^) + D^{Lxpf,^,bp^^)), (4.18) 


and hence, since (apj.^)„gN and {bp^,^)nm are bounded, we deduce from (4.11) and (4.17) that 


i^Pkn ’ “Pfcn ) 0 

(Z/Xpj.^, bpi^^ ) “^ 0 

^ a; 

i^Pk„ )fiGN has a cluster point 
{bpk^ )neN has a cluster point. 


(4.19) 


Consequently, by dropping to a subsequence if necessary and invoking Lemma 4.1(iv), we get 


dpf^ —^ X and bp^ —^ Lx. (4.20) 

Hence, using the fact that V/i(xpj,^) —> Vh{x) and Vj{Lxp^^) —?> Vj(Tx), we derive that V/i(xpj,^) — 
Vh{ap^^) —> 0 and Vj{Lxp^^) — Vj( 6 pj.^) —> 0, which, in view of (3.2), yields 

(4.21) 

Thus, since y* —)> y*, it follows that a* —)• —L*y* and 6 * —> y*. In summary, 

^Pkn rkn jrkn 

gmA3{ap,^,a;j^ix,-L*y*) and gmB 3 {bp,^,b*pj ^ {Lx,y*). (4.22) 

Since graH and grail are closed [9, Proposition 20.33(iii)], we conclude that {x,—L*y*) E graa4 
and {Lx,y*) E grail, and therefore that {x,y*) E Z. □ 

Let us note that, even in Euclidean spaces, it may be easier to evaluate (Vi, + jdip)~^ than the 
usual proximity operator prox.^.^ = (Id +jd(p)~^ introduced by Moreau [31], which is based on 
i = II • lP/ 2 . We provide illustrations of such instances in the standard Euclidean space M”*. 


Example 4.3 Let 7 E ]0, +cx 3 [, let cp E ro(M) be such that dom^ n ]0, +oo[ ^ 0 , and let '& be the 
Boltzmann-Shannon entropy function, i.e.. 


|ln^-e 

, if ^ E ]0, +oo[; 


0 , 

II 

0 

(4.23) 

+ 00 , 

otherwise. 
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Set y?: (?*) is:is:m Z^i!Li ^('^i)- Note that h is a supercoercive Leg¬ 

endre function [5, Sections 5 and 6] and hence Proposition 2.11(iv) asserts that Vh+^d^p is coercive 
and dom. {S7h + jdip)-^ = M"*. Now let e M”", set {r]i)i^i^rn = + let 

W be the Lambert function [21, 26], i.e., the inverse of ^ on [0, -|-oo[, and let i G {1 

Then rji can be computed as follows. 

(i) Let w G M and suppose that 


^ 1 -^ < 0 


Cln^ -cj^, 


if ^ G ]0, -t-oo[; 
if ^ = 0; 


(4.24) 


_+oo, 


otherwise. 


Then rji = 


(ii) Let p G [1, +00 [ and suppose that either (j) = \ ■ \P/p or 



^P/p, ifC€[0 ,+oo[; 

+ 00 , otherwise. 


(4.25) 


Then 



(4.26) 


(hi) Let p G [1, +00 [ and suppose that 



( P/p, ifCG]0,+oo[; 
+ 00 , otherwise. 


(4.27) 


Then 


-1 



(4.28) 


(iv) Let p G ]0,1[ and suppose that 



-e/p, if^G[0,+oo[; 

+ 00 , otherwise. 


(4.29) 


Then 



(4.30) 
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Example 4.4 Let cj) G ro(M) be such that dom(^ n ]0,1[ / 0 and let i9 be the Fermi-Dirac entropy, 
i.e., 


7 ^: ^ < 


^ln^ + (l-01n(l-0, 
0 

+ 00 , 


if C€]0,1[; 
if ^€{0,1}; 
otherwise. 


(4.31) 


Set ip: ^ ^(^i) and h: ^ Note that /i is a Legendre function 

[5, Sections 5 and 6] and that intdomh = ]0, Ip is bounded. Therefore, Proposition 2.11(i) 
asserts that Vh + dip is coercive and that dom (Vh + dip)~^ = M”*. Now let (^j) set 

(Vh + dip) and let i e {1,..., m}. Then rji can be computed as follows. 


(i) Let w G M and suppose that 


if ^ G ]0, +cx)[; 

0 , if e = 0; 

+ 00 , otherwise. 


Then iji = —^/2 + 

(ii) Suppose that 




(l-e)ln(l-0+e, ifeG]-oo,l[; 

1 , if e = 1; 


v+oo, 


otherwise. 


Then iji = I + e ^p2 — 


(4.32) 


(4.33) 
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